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ABSTRACT _ : _ 
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quantitative method of employee perforniance evaluation , _i3 advocated 
for teacher evaluation, DevelopEoent of a BARS consists_generaiiy of 
five steps: a representative sample of potential raters generates the 
scales: the group identifies the broad qua iiti to be evai uated; the 
group formulates general stateEQents_representing various levels of 
performance for each quality and lists examples of behaviors at each 
level; a second groupr representing the ratees^ receives lists of the 
broad dimensions and of the specific behaviors and assigns the 
behaviors to the dimensions: raters then assign unused behaviors to 
describe satisfactory and unsatisfactory employees across several 
dimensions^ A discrimination index is computed for each behavior and 
point values assigned to each. behavior. within the dimensions . Items 
above a criterion level of point variability are eliwinated . Problems 
may arise with the raters • predict ive acumen or possibly with the 
permanent assignment of values. for specif ic_ behaviors. As an example 
of a BARS used in education ^ the scale developed by Marianne Price 
for evaluating_special education teachers in the Montgomery Count y^ 
Pennsylvania^ Intermediate Unit^ is a ppended. This scale measures 
professional growth^ cominunications skills ^ rapport with students ^ 
planning^ instructional skills ^recordkeeping^ behavior management^ 
and interstaff relationships. (MH) 
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ABSTRACT 



The paper addressed the concept, features, format, 
development, and relative merits of using the behaviorally 
anchored rating scale in evaluating teacher performance. 

The discussion provides basic information on a 
technique which is at the cutting edge of industrial 
performance evaiaution. Application of the behaviorally 
anchored rating scale technique to teacher performance" 
evaluation is illustrated. 

Suggestions as to how such a technique might be 
applied in a school district are offered, as well as 
critical comments intended to keep the technique in 
perspective . 
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USE OP THE BEHAVIORALLY . ANCHORED_RATING_ SCALE 
IN EVALUATING TEACHER PERFORMANCE • 



As you are aware, numerous techniques have been 
developed, and are in current use^ for the evaluation of 
employee job performance. There are various r anking 
procedures, including straight ranking ^ alternative ranking, 
paired comparison, and forced distribution techniques. 
There are qualitative methods , including critical incident, 
weighted checklist ^ and forced choice techniques. There are 
management by ob.^ectives approaches. There are also direct 
indexes , including measures of productivity, and measures 
of withdrawal, such as absenteeism and turnover • 

By far the most popular methods of employee per- 
formance evaluation are those quantitative methods known as 
rating methods. [For a fine discussion and comparison of 
the various types of performance evaluation techniques ^ 
see Cummings and Schwab, 1973.] In recent years a new 
quantitative method of employee perform^ance evaluation has 
developed, and has attracted considerable attention in the 
literature. This is the behaviorally anchored rating 
scale, or BARS for short. In the years since I963, when 
the concept was first introduced, more than 125 journal 
articles have appeared in which the authors discuss, develop, 
test, or advocate the use of behaviorally anchored rating 
scales in evaluating employee job performance. (See Schwab 
and Heneman 1975 5 also DeCotiis, 1978). 
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Given the pressures both from within and without 
school districts for reliable and valid teacher performance 
appraisal mechanisms, it may surprise you to learn that only 
one application of the behavlorally anchored rating scale 
technique to public school teaching is reported ±h the 
professional literature. (Price, 1979) Both service and 
business positions have been analyzed, but hot in the public 
schools . 

Let me begin my discussion of behaviorally anchored 
rating scales with a bit of their history. In 1963, 
Patricia Cain Smith ahd t. M. Kendall took note of the 
extreme demands placed upon the quality of ratings in many 
situations. They stressed that such ratings should possess 
reliability both across raters and situations. Both the 
levels and components of such ratings should be clearly 
understood by those assigned the task of making ratings. 
It is only under such circumstances that raters can make 
valid ratings, perhaps more originally, be expected to use 
rating scales with conviction or agreement. The necessary 
concensus among raters can be achieved only if the raters 
themselves define^ in their own terms, the kind of behavior 
which represents each level of each discrimihably different 
characteristic, and which dimension of behavior is illustrated 
by each kind of behavior. The behaviorally anchored rating 
scale is Smith and Kendall *s answer to this problem. 
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• In a few morrierits I shall show you several behavior- 

ally anchored rating scales developed by Marianne Price in 
her doctoral study for the position of Special Education 
Teacher. I want firsts however, to describe the procedure 
under which such scales are developed. eohsideratibn of 
these two : elements separately was inspired by Dickinson and 
Zellinger^ I98O. It is through this procedure that the 
chief advantages of the behavioraliy anchored rating scale 
are achieved. It may be noted in passing that the procedure 
for the development of behavioraliy anchored rating scales 
has been studied informatively independent of the behavior- 
ally anchored rating scale format Itself. 

Smith and Kendall describe the procedure for the 
development of behavioraliy anchored rating scales as 
similar to that employed to ensure the faithfulness of trans- 
lations from one language to another. Material is trans- 
lated into a foreign language, and the.n retranslated by an 
independent translator into the original language. Where 
"slippage" is found to have occurred, corrections are made. 
You w±ll see how this retranslation simile applies to the 
present context in a moment. The behavioraliy anchored 
rating scale development procedure consists generally of 
the: following five steps: 

1. A representative sample of the persons who will 
ultimately serve as raters are enlisted to conduct the basic 
work of generating the behavioraliy anchored rating scales. 



n 

In education, it would seem that this reference f^roup could 
logically include not only administrative raters, but also 
tisachers. The point of calling together the work group is 
not to generate administrative solidarity, but rather common 
understanding and commitment. Doth sides of potential 
evaluation problems ought, in my judgment, to be involved in 
scale development from the outset. V/e have a long history 
in education of such involvement . 

2. The group identifies and lists the broad 
qualities or characteristics to be evaluated. The most 
strongly supported dimensions are selected for further 
analysis. Usually the number, of dimensions centers about 
eight. The participants* own terminology is retained in 
Identifying the dimensions. Let me show you what such a set 
of dimensions might consist of. 

SHOW 0VERHEAD TRANSPARENCY #1. (RJB note the source) 

3. The group then formulates general statements 
representing definitions of high, acceptable, and low per-- 
formance for each dimension, and generates examples of 
behaviors at each level for each dimension. These are 
edited into the form of expectations of specific behavior. 
Let me show you an example of a set of behaviors Indicative 
of one dimension. 

SHOW OVERHEAD TRANSPARENCY #2. (RJB block off left columns.) 
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Note: It may be Worth ribtirlR here that not all InvestiBa- 
tors have identified and defined the broad qualities, 
characteristics, or dimensions first. Some have begun with 
specific behaviors i which are then grouped into appropriate 
categories . 

^. A second group of persons, representative of 
the .'?roup sampled by the original work group, is provided a 
listing of the broad dimensions, and a second list of the 
specific behaviors developed by the first group. They are 
asked to assign the behaviors to the dimensions. Behavioral 
examples are eliminated if there is not a criterion level of 
agreement on the dimension to which behaviors ought to be 
assigned. Qualities or dimensions are eliminated if there 
is not a criterion level of agreement in the behaviors which 
ought to be included. 

5. Other judges, perhaps the first group, are asked 
to use the remaining behaviors to describe the behavior of 
satisfactory and unsatisfactory employees as across the 
several dimensions. A discrimination index is computed for 
each behavior. Judges are also asked to assign certain 
point values to each behavior within dimensions, according 
to its desirability. Items above a criterion level of point 
variability are eliminated. Mean point values for surviving 
behaviors are retained and used in the behaviorally anchored 
rating scale format . 
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Let me turn now to the scale format. You will 

recall the dimerisibris of performance I showed you a moment 

ago. Let me show you several of the scales representing 
these dimensions. 

SHOW OVERHEAD TRANSPARENCIES #3, and #5, if time permits 

The function of the scales is of course to assist in 
the evaluation of employee Job performance. Let me describe 
how the rater is expected to perform this respohsibillty . 
Here I must confess to less guidance in the literature than 
has been present with respect to my prior comments. None- 
theless permit me to offer a few observations. 

The rater is expected, over some no doubt specified 
period, to observe the employee's performance on the Job. 
On each broad dimension of the appropriate set of rating 
scales, the rater assigns a point value to his or her rating 
of employee performance. The specific point values awarded 
are in accordance with the similarity between the behaviors 
observed and those for which points are specified on the 
behaviorally anchored rating scale. The specific comparison 
process followed, and this point is quite clear in Smith and 
Kendall's article, operates as follows. The rater forms a 
clear image of the employee's work, then predict ^ which of 
the behaviors listed in the scale the individual would be 
most likely to display. 
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it is here , iri my Judgment, that the behaviorally 
anchored rating is set adrift. The anchor drags in the 
mud of the rater's predictive powers. There is a second 
flaw, as I see it ^ which makes such anchors' value question- 
able. This is the permanent fixing of point values for the 
specific behaviors used as anchors. My experience both as 
ratee and rater suggests that few teaching behaviors maintain 
the same value from moment to moment, much less from teacher 
to teacher or class to class . 

I recognize that the comments which 1 have just made 
sound contradictory. How can one complain both of the 
unreliability of point values in a scale, and then of the 
false precision in the scale? I suppose that the best 
defense is a good offense. I propose that we not sacrifice 
either for the other. A revision of the behaviorally 
anchored rating scale format, and corresponding minor 
changes in the scale development procedure would, I believe ^ 
preserve the best of both. 

The specific behaviors generated to illustrate the 
dimensions agreed upon ought hot to be sifted out on 
statistical criteria. The value of the behaviors is not in 
their statistical properties, but rather their representative- 
ness of actual teaching behavior. The larger number of 
behaviors generate* could serve as a guide to observation, 
and could provide behavioral anchors, but not for numerical 
ratings, but rather for the exercise of judgment on the part 
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of the rater. Perhaps some dichotomizatioh of positive arid 
negative behaviors could be performed to simplify the Job 
of rating, but this step is beside the point which I am 
trying to make. 

The behaviorally anchored rating scale is not a 
free lunch. Yet it may provide enough nourishment for us to 
continue the search productively for improved methods of 
teacher evaluation . 
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BEHAVieRALLy ANCHORED RATING SCALES PGR EVAtHATING 
THE SPECIAL EDUCATION TEACHERS OP THE 
MONTGOMERY C6UNT1% PENNSYLVANIA, 
INTERMEDIATE UNIJ 



1. PROPESSlONAt GROWTH 

2. COMMUNiCATieN SKILLS 

3. RAPPORT WITH STUDENTS 
APPROPRlATfc PLANNING 

5. INSTRUCTiOflAL SKILLS 

6. RECORD KEEPING AND REPORTING 

7. BEHAVIOR MANAGEMENT 

8. INTERSTAPF RELATIONSHIPS 



DEVELOPED BY MARIANNE PRICE 
1978 
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1. PROFESSIONAL GROWTH 



S eeks improve instructidn 
through the explpratidn of suggest! oris i> 
new ideas> materials^ apprbachesi etc. 



8;0-t 



7.0- 



6.0- 



5.0- 




o 



2.0- 



1.0. 



After identifying her weaknesses,^ teacher 
iakes additional course work to further her 
knowledge. 

*eacher^ attempts hew approaches to teaching 
arid evaluates their success and failure; 

Teacher has several behavior_probiems in 
class i She attends conference concerning 
positive (iiscipline_approaches to seek new 
behavior modification techniques; 

teacher consults prof essional journals in 
er field and implements some of the innova- 
tive ideas contained therein. 

t eacher experiment s wit^^^ new idea that 
was presented at an in-service training con- 
ference. 



A teacher attends a corifererice in her field 
^rid_ when she returns she does riot attempt to 
Implemerit any riew ideas/techniques with her 

students. 

Everi though she received iri-serviee trairi- 
lrig_ on a new readirig program, the teacher 
will riotuse it because it involves a change 
in her planriirig. 

^Teacher attends a convention but only attends 
evening social activities. 



Source : Marianne Price ^ "The Develbpmerit of Behayiorally 
Anchored Rating Scales for the Performance Evaluation of 
Special Education Teachers" _(EdD dissertation. Temple 
University, 1978)^ p. .246. Reproduced by permission. 



2. COMMUNICATION SKILLS 

The ability to exchange inforinatibh 
with administrators, professional 
persons, parents, and other adults 



8. On 



6.0- 



5.0- 




3.0- 



o 



A classroom teacher asfcs a speech therapist 
for information regarding the nature of a par- 
ticular child* s speech problem and how she ^ 
can help. The therapist talks with the teach- 
er about the problem and prepares a list of 
activities that the classroom teacher can_im- ■ 
piement to help the child improve his speech. 

eacher keeps in close contact with counsel- 
ors, or ancillary staff to keep all programs 
working toward the same goals. 

The teacher holds regular conferences with 
parents^ at their convenience. If parents 
are unable to come to the school, she makes 
home visit. 

eacher consults with other professional 
taff in determiriirig appropriate expectations 
for each child in the area of behavior. 

The teacher: confines her conversation with 
parents to her area of expertise^ the class- 
room and instruction, and: thus avoids tread- 
ing into areas in which she lacks credentials 
and certification. 

A child does hot have his homework, so the 
teacher calls the mother and suggests that 
the child simply forgot to bring it to: school, 
rather than accusing the child of hot having 
done it at alii 

Teacher does not inform supervisor of major 
jhanges in a child's educational plan. 

The teacher told the parents all year long _ 
that Johnny was makinggood progress. In the 
Tune conf erence^ the teacher toldJohnny^s par- 
ents that she wanted to have him r evaluated 
because his progress had been unsatisfactory, 

?he_ teacher ignores a parent's request for a 
conference. 



Source 



Marianne Pricey "The Development of Behavlprally 

Anchored Ratlng^Scales for the Performance Evaluatlph of 
Special Education Teachers'' (EdS dissertation. Temple 
University, 1978), p. 247. Reproduced by permissibh. 

IB — 



3. RAPPORT WITH STUDENTS 



The ability to flevelbp an accepting relationship 
with children^ which facilitates their success 
and growth in a learning environment. 




5.0- 



3-0- 



o 



2.0- 



l.o-J 





The teacher observes that a child who has ^ 
difficulty expressing his feelings in front of 

others is extremely upset about something,^ 

"^he also knows that this child is embarrassed 
to let the other students know he is upset . 
The teacher summons his help in running off 
and assembling dittoes in the office. This 
provides an opportunity for the child to talk 
to her. 

The teacher extends to children the same com- 
'men courtesies that she expects her children 
tO'.give to her^ e.g. ^ please^ .thank you^ ex- 
cuse me, etc. 

A student criticizes the teacher's style of 

isciplirie. The teacher : listens to his opin- 
ion and tells. the student vfhy he has chosen 
this method of discipline. 

When, working with distraught adolescents who 
,are having a rough time commuhicatihg with and 
understanding parents^ a teacher relates her 
past experiences and problems in the same area. 



The^ teacher avoids excessive familiarity with 
Students so that he/she is perceived as the 
teacher and not a peer. 



A_ teacher unknowingly mispronounced the child's 
last namei The child soiled himself daily for 

ix weeks until the teacher finally said his 
name correctly, at the soiling of 

his clothing ceased completely. 

Upon completion of instruct! session,^ teach- 

er criticizes student for making numerous 
"errors, rather than focusing on what he com- 
pleted correct.ly. 

During instructional session, teacher remarks, 
—You'll never be able to learn this," when the 
student makes an error. 



Source : Marianne Price, "The Development of Behavioraily 
Anchored Rating Scales for the Performance Evaluation of 
Special Education Teachers" (EdD dissertation. Temple 
University, 1978), p. 248. Reproduced by permission. 



ifi APPR0PRIATE PLANNiNS 



_ _ The ability to syr^Rnxze -instruet-ion 
in order to achieve short and long-term objectives based 
on the needs and level of performance of each child. 



7.0 



6.0 



5.0 



3.0 




i.o-J 



A language therapist reviews all testing data 
on a child and outlines her goals for the 
child. As her program progresses, _ she con- 
'stantly reyaiuates her_ goals and objectives to 
make sure they are still appropriate to the 
child' s needs. 

^The teacher is able to write an educational 
prescription appropriate to the heeds of each 
child . 





The teacher has her lesson plan prepared and 
ail materials that she will be using in a given 
lesson assembled and at hand before the lesson 
begins. 

Teacher determines a student's entry level in 
a reading program on the basis of diagnostic 
test information. 

Teacher organizes books^ pictures^ art mater- 
ials for discussion on national holidays which 
occur during the school year. 

A teacher has identified the long-term goals 
i'dr the child. She knows generally what she 
^wants to do to achieve these so she does not 
develop any short-term objectives. 

Teacher has not planned adequate amount of 
work to keep a student occupied and learning. 

s a result this student is bothering every- 
one else. 

The. teacher assigns the same dittoes as seat- 
work to all children in her class despite the 

act that children' s skills range from the 
first to the fourth-grade levels 

^ 'eacher establishes neither long-range goals 
"^hor shbrt-term objectives for her students. 



Sonrce : Marianne Price, "The Development of Behavidrally 
Anchored Rating -Scales for the Performance Evaluation of 
Special Education Teachers" tEdD dissertation. Temple 
University, ±978), p. 249. Reproduced by permission. 



3. IRSTRUGTIQNAL SKILLS 



fhe itbility to implement the educational program 
through the use of appropriate materials and 
teclmic'ues. 



8. On 



7.0 



o 

M 



6.0 




5.0- 
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The teacher has commercial materials that are 
too advanced for her class. She modifies them 
for use with individual students where possible, 
'^he also has numerous materials that she has 
made herself to fit individual needs. 

In order to maintain the attention and inter- 
est of students^ _ the teacher varies the pace of 
her instruction beginning with pericil-arid- 
paper activities' which demand much cone ehtra- 
tioh bh the part of the student arid moving to 

jnore relaxing activity such as an instruc- 
tional game when she notices that the child's 

ttentioh for the pencil-arid- paper task is 
waning. 

, fter a child is taught a particular skill, 
the teacher reinforces this skill. 

The teacher is instructing a studerit iri a 
second-grade level math book, but the student 
^has not committed the basic additiori arid sub- 
traction facts_ to memory. The teacher assigns 
s t ud en t to an _ activity c en t e r wh e r e h e _ pr a c - 
tices these facts on a teaching machine. 

The teacher uses the weekly magazine, J^^ws 
^Pilo^, to discuss current events and vari 
social studies and science-related topics with 
her students. 

The teacher follows text in sequential order, 
"making daily assignments to each pupil. Help 
is given each pupil as it is needed. No sup^ 
plementary materials are used. No instruction 
per se is given. 

The teacher uses audio-visual materials, e.g. , 
^films^ tapeSi to fill up time^ with no thought 
"being given to their relationship to the in- 
structional program. 

1.0 J ^ While teaching beginning reading, a teacher^ 

uses teacher-made dittoes on which the priJiting 
is very small and unclear. 

Source : Marianne Price, "The Development of Behavldraily 
fihehored Rating Scales for the . Performance Evaluation of 
Special. Education Teachers'' (EdS dissertation^ fempie 
HniversitVi 1978^; Oi g50i jtenroduced by nermissloni 



4.0- 



3-0- 



o 



2.0- 



6. REG0RD KEEPING AND REPORTiNS 



The ability to keep accurate and current records , using 
this information for comprehensive reporting as required. 



8.0 



7.0 



6.0 



5.0 



4.0- 



3.0 



o 



2.0- 




Reports are always objectively written and sub- 
stantiated by records? they are submitted with- 
in time requirements. 




Tfte_ teacher documents (in writ the instruc- 

■"ohal goals and objectives she holds for 
each child. 

The teacher gives a detailed account of when 
JL child has a tantrum, including the time of 
the tantrum and the behavior that preceded 
the tantrum. 

^The special education teacher documents the 
communications she has with regular class 
teachers about special education students. 

When asked to justify Johnny's placement in 

third-grade math text ,^ t teacher is able 
to_presentKey_Math Diagnostic Test results 
and the textbook placement tests to substan- 
tiate placement at the third-grade level. 

The. teacher keeps a daily attendance record, 
ollects absence information, and. hands in 
ttendariee report every two weeks. 

After administering various testing instru- 

ents to a student, the teacher places the 
results in the student's file. 

ft teacher claims she' has "tried everything"_t6 
get Johnny to do his assignmehts_but ^'nothing 
works. The teacher * s supervisor asks to see 
a record of what has beeh_tried^ _f or how long, 
etc., so that she can offer direction^to the 
-teacher. The teacher has no written record 
of what has been done and can only give the 
supervisor vague recollections regarding each 
type of intervention that was tried; 

Teacher writes reports which Include emo- 
:ionaiiy iadeh unsubstantiated comments. 



Marianne Price , "The Development of Behavlorally 



i.dJ 

Source : 

Anchored Rating Scales for the Performance Evaluation of 
Special Education Teachers" (EdD dissertation. Temple 
University, 197J3), p. 251. - Reproduced by permission; 



7i BEHftViGR MftNASEMENT 

fhe^ability to establish and main tain a behav - 
ioral atmo-spioej^e that is conducive to learning. 



8.6-i 



7.0 



6.0- 




3.0 



1 

Ml 



2.0- 



1.0^ 





The teacher established a behavior modifiea- 
tion system Involving group and individual 
_oals for classroom behavior. Varyihg types 
and rates of reinforcement are established 
for individual students. 

The teacher is alert to situations that can 
erupt into disruptive behavior. She takes 
steps to avert trouble before it occurs. 

The teacher _ identifies student behaviors which 
.interfere with the total learning process. 
She implements _a behavior modification system 
utilizing reinfbrcers appropriate to each 
student. 

The teacher uses a token ' economy with child who 
does not respond to social reinforcement. 

A student has been evidencing disruptive be-- 
havior in the classroom in the form of calling 
out and interrupting. The teacher initiates a 
system for taking turns in speaking and asking 
questions. 

Teacher rewards positive behaviors of children, 
ignores negative behavior. 

i^The teacher takes away privileges to ebntrdl 
classroom behavior. 

A teacher yelled at a student in a classroom 
'because he misbehaved. The child rah out of 
school. 

J'upils frequently swear and engage in name 
^calling. The teacher reprimands them each time 

this occurs. No decrease in the inappropriate 

verbal behavior is noted. 

Verbal and physically aggressive behavior_f re- 
_quehtly occurs in the classroom. The teacher 
"provides no consistent consequences to these 

behaviors. 



Source : Marianne Price , *'The Development _of Behaviorally 
Anchored Rating Scales for the Performance Evaluation of 
Special Education Teachers " (EdD dissertation. Temple 
University, 1978), p. 252. Reproduced by permission. 
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8. INTERSTAFF RELATIONSHIPS 

The ability to build and aeveloD positive re - 
. lationships wLtfa 1. \J . ahd/or district staff . 



8.0- 



7.0. 



6.0- 




5.0. 



4.0- 



3.0- 



2.0- 



i.dJ 



A hearing therapist vdluhteers. her services 
to a school oh an Open School Night for 
parents program by offering to speak, test 
hearing or whatever services _the principal 
or other teachers may waht of her. 

The teacher volunteered to "serve" an extra 
duty for a regular staff member who became 
ill. 

When the pidncipal gave permission to have a 
^littD machine placed in the speech therapy 
room, the therapist said, "I wouid_like to do 
my job effectively. It is impossible to con- 
duct speech therapy classes effectively when 

the ditto machine is being used. Let^s work 

but a schedule for use of the ditto machine." 

.The I. U. speciial class teacher adheres_to 
^he time schedules arid the policies of the 
school ih which she works. 

Special class teacher maintains good public 
^relations with regular class teachers by eat- 
ing lunch with them. and conversing with them 
oh a persohal as well as professional level. 



I. U. Self-contained teacher ih district build^ 
^ing does not follow normal chahhels of communi- 
cation within the building. 

.An itinerant teacher fails to inform the school 
office that she is ill and will be absent. 



Source : Marianne Price, "The Development of Behavioraiiy 
Anchored. Rating Scales for the Performance Evaluation of 
Special Education Teachers" (EdD dissertation. Temple 
University, 1978), p. 253. Reproduced by permission. 



